Displays of user select icons with an axes-based multimedia interface

ABSTRACT

A method of displaying an on-screen graphical user interface, the method comprising providing a plurality of user-selectable icons, and a plurality of content icons representing respective items of contents; generating image data for the on-screen user-interface with a multi-dimensional array which includes a first axis comprising the plurality of user-selectable icons adapted to be arranged in a specific direction and which is also adapted to include a second axis comprising the plurality of content icons in a direction intersecting, or abutting, the first axis; and outputting the image data for the on-screen user interface related to displaying the contents to a display, wherein the generating displays the second axis to intersect, or abut, the first axis.

CROSS-REFERENCE

This application relates to, claims priority from and is a continuationapplication of U.S. patent application Ser. No. 11/970,860, filed Jan.8, 2008 entitled MULTIMEDIA INTERFACE, which claims priority from and isa divisional application of U.S. patent application Ser. No. 10/265,443,filed Oct. 7, 2002 entitled MULTI-DIMENSIONAL LOCATING SYSTEM ANDMETHOD, which claims priority on U.S. provisional patent applicationSer. 60/329,146, filed on Oct. 15, 2001, entitled SYSTEM, METHOD ANDSOFTWARE FOR INSERTING (INTRODUCING), LOCATING, VIEWING, MANIPULATINGAND EXTRACTING FILES FROM A COMPUTER DATABASE VIA A PENTA-DIMENSIONALGRAPHIC INTERFACE. All previous documents are incorporated herein byreference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to computer systems and morespecifically to user interface that manages user-selectable icons andcontent icons.

2. Description of the Related Art

Computer systems are changing the way we live. They give access to atremendous computing power. Now everybody can own and operate a computersystem. The evolution of computer systems and software happens quiterapidly. Thirty years ago computers were huge mainframe units with lesscomputer power than today's small calculators; now we have small andpowerful computer systems that are relatively inexpensive.

Because they have become sufficiently powerful, computer systems are nowpart of our everyday communication tools, allowing their users to storelarger and larger quantities of data (i.e. information). Given theever-increasing scale and diversity of information and applications onthe Internet, improving the technology of information retrieval isimportant. Information on every form (i.e. data, audio, picture, video .. . ) is now easily accessible like never before with the Internet.Therefore, the data quantity the computer system user has to deal withis growing at an accelerated rate. The volume of information is alreadyso high that the time necessary to deal properly with it is oftenunacceptable especially for professionals, scientists and businesspeople. However, in order for that information to become actually usableknowledge, it needs to be easily accessible and understandable.

Evolution of computer science over recent years has allowed nearly alltypes of information to be digitized and transformed into a computerfile. The sources of information are numerous, therefore it is difficultfor prior art computer systems to store information in a manner that: A)allows retrieval through a common process/presentation, B) allows thestorage structure to be adjusted to his/her thinking process, C) allowsthe user to create links between the elements of information and D)provides visualization that clearly shows the continuity betweendifferent elements of information that are using a different time frame.In consequence, the task of efficiently gathering and extractinginformation from documents may be both difficult and tedious.

The systems well known in the art, however, are designed so that theuser has to adapt to the filing systems rather than the other wayaround. Furthermore, the filing process will generally lead to someextent, to the loss of the flow of information, as portions ofinformation are separated during the filing process. Creating multiplelinks is usually tedious, complicated, requires self-discipline and isvery costly in terms of memory space.

Conventional computer systems for organizing information are oftenimplemented as part of the operating system of the computer system andare therefore provided as a basic utility to the user of the system toallow the user to organize information in a manner embedded in theoperating system.

The main organizing system that is usually provided with existingoperating systems is the hierarchical filing system. The hierarchicalfiling system is well known in the prior art and provides a hierarchy offolders (i.e. directories or subdirectories) into which the user maystore information, such as text documents, data, pictures, videos, andmusic files.

Classification and accessibility to the information usually require userknowledge of numerous applications, as well as, self-discipline in themapping of the data storage system. Each type of file has a uniquesoftware that is suited to open it. Now, the Internet provides some kindof interchangeability between files of differing format although theinterchangeability is often limited to Internet related files (i.e.HTML, XML, JAVA . . . ).

Even if the meaning of one information as part of a group of informationis critical, generally it is not possible to have a global overview ofall the various types of information recorded because of the number ofdifferent programs needed to visualize the different file types. Thelinks between various files relate to a common topic and are not obviousto the user.

The most popular hierarchical filing system in operating systems areWindows™ Explorer™ on Windows™ operating system and the Finder™ on theMacintosh™ operating system. Despite popularity, the systems providetools that manage efficiently only small quantities of information at atime. These systems both remain restrained to filing by file names usingthe “save as” function in most applications. With this kind ofclassification a user can only have a “local” view on what is stored inthe computer system; a problem typically occurs when the informationquantity is too large and diversified. The problem is exacerbated iflinks between the different information are provided between theinformation locally stored in various folders.

While the hierarchical filing system allows a user to specify astructure within which to file and store information in order to avoidthe clutter of a single folder receptacle, the hierarchical structureforces the computer user to be as organized as possible in filinginformation. If the user has difficulty in filing documents because ofthe difficulty in deciding the proper categories for the document (e.g.the document does not clearly apply to only one specific folder), theuser can file the document in a folder where it will be difficult toretrieve considering it could have been placed logically in manydifferent folders. The usual manner prior art systems use would be tosave a copy of a document in as many different directories as there arelinks and save linked documents in the same directories. Such anapproach is labor-intensive, requires considerable self-discipline, andis extremely costly in terms of memory space. Furthermore, the linksbetween the documents remain non-evident.

As more and more documents are stored in the computer system memory, anincreasing number of documents are arbitrarily stored in thehierarchical filing system. The user begins to have a bewilderingclutter of documents in every folder. Some of the documents aremisplaced or should have been located in many folders at the same time.With time, the user's needs change and the hierarchical filing systemmust be updated with newer considerations but most users are dissuadedbecause of the known difficulty and time requirements. Usually, usersprefer to continue saving files to the same directories and folders andthen wishing they could remember where the files were stored. Inaddition, the time needed to search in that kind of hierarchical filingsystem becomes more and more important as the number of files isgrowing.

It should be noted that the difficulty in filing documents in a computersystem also affects the way the user interacts with the computer in thatthe user attempts to avoid the difficult work involved in filing adocument that is hard to categorize. This tends to result in thecomputer becoming cluttered with documents that are hard to categorizeor otherwise filed or the user does not attempt to place the documentsin the computer system memory at all because of the realization it willbe difficult to organize. This effect tends to negate the advantages ofa filing system that has a hierarchical filing system with a graphicaluser interface.

Every user has a preferred manner to file information in a computersystem. Some prefer a file name to distinguish each document whileothers will implement different hierarchical architecture. Other userswill file information according to time. It is hard for someone else tounderstand what the computer system is keeping in its memory consideringthe different ways users can tailor the hierarchical filing system. Itis hard to understand what is important, what is not, and what isrelated to what. Interchangeable knowledge is still difficult to attain.This is evident in that it is often difficult to understand theinformation on an unfamiliar computer and the time needed to familiarizeoneself with an unfamiliar system is often time-prohibitive.

Prior art information organizing systems usually do not provide a way toeasily understand links between the information. Every information isusually considered as a unique piece of information and only the creatorof the information is aware as to what it relates to. An E-mail, a webpage, a spreadsheet, or a text document are certainly information butthe value they have is limited as long as the links between them is notobvious to another user. Computer system do not have informationorganizing system that allow the user to perceive efficiently the linksthat connect information elements in an “understandable story” to getthe whole meaning of the information. That is, the user is stilloblivious to the trends underneath the information.

When one is given a document to review, there is often a desire toannotate the electronic document similar to annotating a paper copy.Doing so with an electronic document will, similar to the paper version,result in permanent alteration of the base document unless a second copyis made. Furthermore, if different notes and comments are aimed atdifferent individuals, there needs to be as many different copies asthere are targets or receivers. It then may be desirable that suchannotations be made on a layer that does not alter the original documentto avoid creating new documents for each desired target.

In addition, conventional information organizing systems suffer from atleast another disadvantage: they do not provide a tool to easily searchand visualize the search results starting with an arbitrary informationelement. Search results provided by conventional information organizingsystem are given in order of relevancy using typed text as a searchinginterface. Results are not given using pictures or images although theinformation would be much more valuable since it is not possible toexplain in a short paragraph what a picture can show. When the user isdoing a search within a conventional organizing system or even withInternet search engines, the user is usually beginning searching withspecific words, topics, or file formats. This allows the user to isolateinformation elements that contain the searched words either in the titleor in the file itself. It is similar with file format in that only filenames of a specific format will be showed as a search result.

Often, results will be presented by relevancy using a listing. Relevancyis based on arbitrary considerations depending on the search engineused. That kind of search fails to present search results where therelated links with the information element are clearly shown.

With a conventional information managing system, the user must oftenmeticulously store documents in numerous directories. Easily displayingall the elements linked and their sequence of entry is usuallydifficult. Furthermore, displaying all the elements of informationlinked by a combination of attributes to display all the linked elementsin the order or sequence that they have been entered (it may, forinstance, be useful to show a series of communications that have led toa final memo, or a series of reports that have led to a givenprofessional decision) is also impossible.

Conventional information managing systems are often time-consuming andinclude obstacles that prevent users from maintaining a structuredmanner, important quantities of information regularly.

For example, if a user wants to keep a “life long” information journalor logbook, the user cannot use prior art information organizing systemsto record the information from his/her life. It is not possible for anindividual to record and to file various information elements frommultiple sources over a long period of time and hope that someone elsewill be able to understand quickly and efficiently the meaning of theinformation, the relationship between the information elements as wellas the order in which the events occurred.

In corporate environments, it is important that the “knowledge” of thecorporation remains usable, regardless of the employment status of theauthor. Additionally, it is also desirable that the data managementmethods used by employees be unified, both for efficiency andease-of-training reasons. That is, a unified system enables thedecision-making process to be more coherent. An efficient and coherentinformation managing system should also be an intricate part of acompany quality assurance program.

Furthermore, companies that are engaged in extensive research anddevelopment generate substantial files and documents from severalsources. As a result, these document-driven firms need a tool toefficiently track these documents. It can be useful to keep track ofproject history and the objective behind each stage of the project. Bymaintaining a detailed history, additional projects may be fostered andrepetitive projects avoided.

Adding to the need for efficient and organized document management isprofessional employee turnover. One example of an incentive for astructured file management structure is tax incentive. In somecountries, research and development can be tax deductible. In order tohave access to the R&D tax credit a company must prove the work was doneand with the current filing systems it represents an enormous task tofind the information needed to make the proof.

Knowledge tracking, recording, and interchangeability represent aconstant challenge and a huge task that prior art systems cannotadequately accommodate.

Maintaining an address book and a calendar or agenda are usuallyconsidered by conventional information managing systems as separatetasks using separate software. These two relations to information arefundamental and should be included in a complete designed informationmanaging system.

The prior art computer systems or computer interfaces have not providedsolutions to deal with the aforementioned problems and each of thesedeficiencies in the prior art yield a demand for an improved informationmanaging system and method using an intuitive and natural way tovisually present information as well as the associations between theinformation.

SUMMARY OF THE INVENTION

The following presents a simplified summary of the disclosure in orderto provide a basic understanding to the reader. This summary is not anexhaustive or limiting overview of the disclosure. The summary is notprovided to identify key and, or critical elements of the invention,delineate the scope of the invention, or limit the scope of theinvention in any way. Its sole purpose is to present some of the objectsand aspects disclosed in a simplified form, as an introduction to themore detailed description that is presented later.

It is, therefore, desirable to provide a method and a system thatorganize information that is an improvement over known informationorganizing methods and systems.

The present patent application provides non-transitory computer-readablemedium that includes computer-readable instructions operable to performa method of displaying an on-screen graphical user interface, the methodcomprising providing a plurality of user-selectable icons, and aplurality of content icons representing respective items of contents;generating image data for the on-screen user-interface with amulti-dimensional array which includes a first axis comprising theplurality of user-selectable icons adapted to be arranged in a specificdirection and which is also adapted to include a second axis comprisingthe plurality of content icons in a direction intersecting, or abutting,the first axis; and outputting the image data for the on-screen userinterface related to displaying the contents to a display, wherein thegenerating displays the second axis to intersect, or abut, the firstaxis, in accordance with at least one embodiment of the invention.

The present patent application provides a non-transitorycomputer-readable medium that includes computer-readable instructionsoperable to provide a user interface comprising a first axis ofuser-selectable icons, at least some of the user-selectable icons beingadapted to display a second axis of user-selectable icons thereof, thesecond axis of user-selectable icons being substantially orthogonallydisplayable about the first axis of user-selectable icons, in accordancewith at least one embodiment of the invention.

The present patent application provides system capable of displayingcontents, comprising a control which acquires an instruction fordisplaying of contents via a user manipulation; a storage which storesdata for a plurality of attribute icons associated with respective typesof content, and data for a plurality of content icons representingrespective items of contents; a display output module which outputsimage data for an on-screen menu related to displaying of the contentsto a display and which displays the contents acquired from the storagein response to the user's instruction acquired by the control; a displaycontroller which generates the image data for the on-screen menu with amulti-dimensional array which includes a first axis comprising theplurality of attribute icons arranged in a specific direction on ascreen and which also includes a second axis comprising the plurality ofcontent icons in a direction intersecting, or abutting, the first axison the screen, wherein the display controller displays the second axisto intersect, or abut, the first axis at a position of one of theattribute icons selected by the user, and, if the contents are adaptedto be chronologically ordered, represents the chronology by displayingthe content icons in chronological order in the second axis, inaccordance with at least one embodiment of the invention.

These and other advantages and features of the present invention willbecome apparent from the following description and the attacheddrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block-diagram of the sources of information leading togrowth in knowledge;

FIG. 2 depicts the growth of an individual's knowledge in time using thevector theory;

FIG. 3 depicts multiple individual's vectors in time;

FIG. 4 depicts the parallel vectors of individuals in time and thecontacts leading to the exchange of information between them;

FIG. 5 depicts the bicephal (personal/professional) aspect of anindividual's path in time;

FIG. 6 is a block-diagram of an integrated hardware and softwarecomputer system;

FIG. 7 is a block-diagram of a filing process controlled by the SMLOI;

FIG. 8 is a block-diagram of the multiple unique filing processcontrolled by a prior art operating system;

FIG. 9 is a block-diagram where the multiple-link part of the filingprocess is controlled by the SMLOI;

FIG. 10 is a block-diagram of the information insertion levels in theSMLOI;

FIG. 11 depicts the notions of information's layer, version andassembly;

FIG. 12 depicts the SMLOI information element;

FIG. 13 a depicts a real-life document and a date and time counter;

FIG. 13 b depicts a unified format representation of a document;

FIG. 14 depicts a more detailed view of the characterization attributewindow from the attribute sub-area in the SMLOI;

FIG. 15 depicts a SMLOI information element, an unified formatrepresentation of an audio document;

FIG. 16 depicts an alternate dynamic assembly of an audio unified formatrepresentation document in the SMLOI;

FIG. 17 depicts a SMLOI information element, a unified formatrepresentation of a video document;

FIG. 18 depicts an alternate dynamic assembly of a unified formatrepresentation video document;

FIG. 19 a depicts a unified format representation of an Internet sourceddocument;

FIG. 19 b depicts an alternative unified format representation of thesame internet sourced document;

FIG. 20 depicts an unified format representation of an odd-sizeddocument;

FIG. 21 depicts an unified format representation of an odd-sizeddocument resized in a standard SMLOI information element size;

FIG. 22 depicts an unified format representation of a reference to anon-electronic document;

FIG. 23 depicts a SMLOI basic entry sequencing applied to an unifiedformat representation of a document as it is inserted in the SMLOI;

FIG. 24 depicts an alternative “pile” methods of graphicallyrepresenting the information element order in the SMLOI;

FIG. 25 depicts an alternative “roll” method of graphically representingthe information element order in the SMLOI;

FIG. 26 depicts the use of bookmarks in the SMLOI;

FIG. 27 depicts a bi-dimensional view of two information element vectorsin the SMLOI;

FIG. 28 depicts a bi-dimensional view of multiple vertical informationelement vectors in the SMLOI;

FIG. 29 depicts a tri-dimensional view of three information elementvectors in the SMLOI;

FIG. 30 depicts a tri-dimensional view of three information elementvectors in addition to a fourth circular vector in the SMLOI;

FIG. 31 depicts the second relative information element vectorpossibilities according to the fourth circular vector;

FIG. 32 is a typical corporate bloc diagram;

FIG. 33 depicts an alternative SMLOI in a multi-user corporateenvironment;

FIG. 34 is an access grid from a SMLOI in a multi-user corporateenvironment;

FIG. 35 depicts an alternate SMLOI in a multi-user corporateenvironment;

FIG. 36 depicts an alternative SMLOI access bloc diagram for a typicalcorporate environment;

FIG. 37 depicts a uni-dimensional view of the SMLOI with access codes;

FIG. 38 depicts a limited access view of the SMLOI;

FIG. 39 depicts a privacy-enhanced view of the SMLOI;

FIG. 40 depicts a bi-dimensional limited access view of the SMLOI;

FIG. 41 depicts a uni-dimensional view of the SMLOI;

FIG. 42 depicts shows a uni-dimensional view of the SMLOI inprivacy-enhanced mode;

FIG. 43 depicts a proposed graphical interface for the SMLOI;

FIG. 44 depicts multiple view size windows of the SMLOI;

FIG. 45 depicts a radar-screen in the SMLOI;

FIG. 46 depicts a radar-screen presenting the future in the SMLOI;

FIG. 47 depicts a view of the SMLOI in a web browser window;

FIG. 48 depicts SMLOI as part of a typical game console;

FIG. 49 depicts a typical game console controller;

FIG. 50 depicts a path using multiple information element vectors; and

FIG. 51 depicts two non-parallel information element vectors.

DESCRIPTION OF EMBODIMENT(S) OF THE INVENTION

A System and Method for Locating and Organizing Information (SMLOI)stored in the memory of a computer system will now be described indetail. The following description, specific steps, procedures, method,commands, graphic representation, computer user interface and otherspecifics are set forth in order to provide a thorough understanding ofthe present invention. However, it will be apparent to one skilled inthe art that the present description of the invention provides only oneexample of how someone skilled in the art can produce the claimedinvention. It will also be apparent to one skilled in the art that thepresent invention may be practiced without the specific details. Inother instances, well known systems and methods are shown in schematicand diagrammatic form or not shown at all in order not to obscure withunnecessary details the present invention.

The “Vector” Knowledge Theory

In order to build a good knowledge management system it is necessary toanalyze how knowledge is acquired and how it is processed by a humanbeing. A model was created to help understand how people are managinginformation and knowledge.

To improve the efficiency of knowledge management, the usefulness of theknowledge should be increased. If the knowledge is defined as the sum ofthe information retained, it can be said that the increase in efficiencyof knowledge management can be attained by improving the usefulness ofthe retained information. The usefulness of the information lies in itsability to be understood, recorded, classified, retrieved, extracted andshared.

FIG. 1 illustrates how someone's knowledge level 10 increases.Information is acquired through contact 14 with other individuals orlearned 12. The learned information 12 can be provided by actions 16 andevents 18. FIG. 1 illustrates also that information acquired throughcontact 14 with other individuals can come from meetings or minutes 20,messages or conversations 22, and documents 24.

The information gathering process is continuous for an individual. FIG.2 shows the path of an individual, schematized by a cylindrical shape30, relative to the absolute time vector 32, as being a continuousgathering of information. The cylindrical shape 30 is a schematizedvector and will be explained in details later in this description. Thegathering process is operating through actions “a” 34, contacts “c” 36and events “e” 38 for the purpose of this description. The amount of theknowledge or information is represented by the cross area 40 of thecylindrical shape 30, and, as information is acquired through time 32,the knowledge is increased, hence, diameter D₂ 44>diameter D₁ 46.

FIG. 3 shows three cylindrical shapes 30 that represent the continuous,parallel paths of three different individuals 50, 52, and 54,respectively, relative to time 32. Interaction 72 occurs betweenindividuals 50, 52, and 54 at time point 56 on the absolute time vector32.

FIG. 4 shows the continuous, parallel path of individuals 50, 52, 54,60, 62, 64, and 66, respectively, relative to time 32. Interaction 76occurs between individuals 64 and 66 at time point 68, interaction 74occurs between individuals 50 and 60 at time point 70, and interaction72 occurs between individuals 50, 52 and 54 at time point 56. Atinteractions 72, 74, and 76 the contacts are likely to generate anexchange of information. The information can be of a personnel or aprofessional nature. For example, if individuals 50, 52, and 54 areemployees of the same company their professional information transmittedduring event 72 at time point 56 may be labeled as corporate.

FIG. 5 shows the path of individual 50, 52, 54 and 60 with oneprofessional interaction 72 at time point 56 and one personalinteraction 74 at time point 70. Personal interaction 74 is labeled andconsidered differently than a professional interaction 72.

The cylinder 30 diameter variation, as shown in FIGS. 2 to 5, representsthe amount of knowledge 10 acquired by an individual. Equations andalgorithms can be applied to that cylindrical representation 30 of theincreasing diameter 46. Some of the variables may be the time vector 32,the cross area 40 of the cylinder 30, the time between contacts, thenumber of individuals, the nature of contacts, the diameter variationrate, the contact rate, the event rate, and the communication rate.

Accordingly, this theory, as schematized by this model, considers thetime as a major reference in the knowledge gathering process of anindividual. Different interactions between individuals generateinformation exchange. Further in the description it will be useful tounderstand that the schematized cylindrical shape 30 is a vector,further described as 230 and 232, in the SMLOI.

The Computer System

The System and Method for Locating and Organizing Information (SMLOI) ofthe present invention is part of a computer system such as the one shownin FIG. 6. The computer system shown in FIG. 6 is a complicated one, itcould have been described only by an input/output interface unit, asystem bus or network, a storage device and a processor. The type ofcomputer system presented in FIG. 6, that is well known by one skilledin the art, includes a processing means, such as a microprocessor, amemory mean 84, such as system RAM, and a storage means that can benetwork based, such as a hard disk or other storage means having a highcapacity for storing documents and other information maintained by thefiling system. The processing means 82, the memory means 84, and thestorage means 86 (which may have its own I/O controller 88) areinterconnected by a system bus 90 which includes control signals as wellas address lines and data lines for sharing information, including dataand instructions, between the components of the computer system. Alsoconnected to the system bus 90 is an I/O controller 92 which controlsthe signals received from a keyboard 94, a mouse 96, an image capturedevice 100, a microphone 102, and a game control 98 and provide thosesignals, which indicate instructions from the user, to the computersystem. A display controller 104 is coupled to the system bus 90 andreceives commands and data from the processing means 82 and from thememory means 84 via system bus 90. Display controller 104 controls adisplay device 106 in order to provide images for the user. It will beappreciated that the typical computer system includes a bit mappedscreen stored in memory, which may be a dedicated frame buffer memory105 or the system memory. As shown in FIG. 6, a display means 106displays on a display screen 108 a cursor 110, which is controlled bythe pointing device 96. The display means 106 may be any one of avariety of known display systems, such as a video (CRT) display monitoror a liquid crystal display. Future display devices such as E-paper,rolled screen and other display devices such as direct retinaprojection, direct brain stimulation means, and means for 3Drepresentation are also considered as appropriate display devices. TheSMLOI can also use a gaming console or a portable data assistant (PDA)as a computer system.

The pointing device 110 of the present invention may be substantiallyidentical to the cursor control means shown in U.S. Pat. No. Reissue32,632. However, it will be understood by those in the art that manyother types of cursor control means may be utilized, such as graphictablets, keyboard, touch tablets, trackballs, pen input mechanisms,touch screens, game controller for game console, etc. Indeed, any devicecapable of indicating x-y locations and capable of controlling a cursoron a display means of the computer system may be utilized in the presentSMLOI as a pointing device. This includes the “target point” located inthe center of the display means in action video games.

The pointing device, such as a mouse 96 will often include a signalgeneration means which typically includes a switch connected to a button97. A user presses the button 97 to send one signal to the computer andreleases the button to send another signal to the computer. Other signalgeneration means, as is well known in the art, may be used such as usingcertain keys on a keyboard 94 or using a pen input device whichpositions a cursor and, by pressing the pen's tip, or simply a finger,against the display screen, selects the item pointed to/pressed at onthe display screen.

Other kind of devices can be utilized as pointing devices and can alsowork to indicate x-y and x-y-z locations if the display device allowsthe user to perceive a third dimension. Game pad, tactile glove, voiceactivation and other kind of pointing devices means are considered asappropriate pointing devices.

Entering a document, which can be any kind of digitized information, inthe present invention can be made in more than one way, through at leastone action on the computer system. One way is as the user is working ona document through an application software to click on the designatedSMLOI icon located in typical windows-like operating system in the “taskbar” or “status bar”. One alternate way in a typical windows-likeoperating system is to drag a document (opened or not) on the SMLOI iconon the “desktop” and drop it. One other alternate way is for the user toconsider his/her SMLOI as a printer, and do a print-to-the-SMLOIcommand. One other alternative way could be for the user to considerhis/her SMLOI as a drive, and do a save-under-the-SMLOI command. TheSMLOI icon can sit in the “dock” in an apple-like environment. The SMLOIcan also have embedded functions in other applications thatautomatically achieve the same actions or tasks.

In the SMLOI, the management of the computer memory space allocation canbe handled by the SMLOI. FIG. 7 shows a block-diagram of such a handlingfrom the SMLOI. The document 102 is linked to the characteristics 117and stored 109 under the SMLOI. The SMLOI can generate a standard file114 on the storage means 86. The SMLOI could provide the added benefitof automatically encoding and/or encrypting all files and generating aunique or multiple “.SMLOI” type files 115 making their access withoutthe SMLOI impossible, thus increasing security.

All existing documents or other data in a computer system directory canbe entered in the SMLOI as the SMLOI is installed on the computer. Allfiles from different memory devices and storage devices such as a floppydisk, a hard drive, magnetic tape, optical drive, RAM, Flash memory,DVD, CD-ROM or other memory support can be entered as SMLOI elements asa result of a single enter-in-SMLOI command. All incoming e-mails andtheir attached files can be entered in the SMLOI as a result of thechoice of such a default mode in the SMLOI setup options.

The SMLOI reduces the number of times a document file has to be saved inthe computer memory means. FIG. 8 shows a block-diagram of a prior artsystem, where a document 112 gets linked to four different subjects ortopics, namely A, B, C and D. This is accomplished by filing copies ofthe document into four different directories 120, occupying fourlocations 121 in the computer's memory and four times the memory space.FIG. 9 presents a block-diagram of the SMLOI where a document 112 issingly stored in the computer's memory (through the operating system OSor SMLOI) and entered in the SMLOI. The document is then attributedrelated characteristics. The only memory spaces occupied are then forthe document itself 124, and its SMLOI-only information 126,respectively.

FIG. 10 shows a block-diagram of the system levels. Level zerocorresponds to the level without the SMLOI. Level one 130 is attainedthrough installation of the SMLOI. Level one 130 allows the SMLOI torecord a document with minimum interaction with the user. Level one 130considers the primary insertion 133 as a “drag and drop” like meansaction from the user. The SMLOI automatically records the informationlinked to the document 112 such as the file format 135, the time theinsertion in the SMLOI was made, and the size of the file. Thesecharacteristics are considered as intrinsic characteristics 136 becausethey only ask for the insertion action from the user.

Level two 131, as presented on FIG. 10, is the same as level one 130with the addition of extrinsic characteristics 138. Extrinsiccharacteristics 138 correspond to the information known by the user thathelps with understanding the meaning of the document 112, to that whichit relates, and all other information that can assist with understandingthe value of the document 112. Simply, each document has its own uniqueextrinsic characteristics. The addition of the extrinsic characteristicsrequires more actions from the user. As such, level two 131 isconsidered a secondary insertion 140 because it can be done at adifferent time from the primary insertion 133 in the SMLOI. Level two131 also allows the user to modify intrinsic characteristics 141. Levelone 130 and level two 131 do not alter the document in the SMLOI itself.

Level three 132 brings the user to a level where the document may bemodified in the SMLOI. Annotations 142 can be made by the user in orderto add more meaning to the document already entered in the SMLOI. Theannotation, namely a layer 143, can be considered as a distinctdocument. FIG. 11 shows an annotation 142 on which the user can chose tomerge 146 the layer 143 so it will become an assembly 144. An assembly144 is an independent document. Actions on documents through applicationsoftware can be monitored by the SMLOI and altered documents being savedand entered automatically as new annotations in the SMLOI as a level one130 insertion.

In order to increase the efficiency of the SMLOI, computer peripheralsthat are well known in the art such as printers, scanners, or safetysystems such as the ones used for biometrics recognition of the user canbe under direct control of the SMLOI. The SMLOI can also rely on theoperating system (OS) to accomplish these tasks. To further increase theefficiency of the SMLOI without requiring too much of the user, linksbetween the SMLOI and certain application software for functions such ase-mail, agenda/schedule or network access may also be provided.

In order to capture ongoing audio stream media or video stream media, amemory buffer allows the user to constantly record information so theuser can keep information before he/she gives the recording order. Thememory buffer continuously records the streaming media that was seenand/or heard by the user. The buffer has a user's specified time lengthand eliminates old data to record new data unless the user hasinstructed the system to record that which is in memory. Useful data isthen kept in another memory location for further consultation.

The Information Element

A document, or every other kind of data, recorded in the SMLOI ispreferably represented using a unified format. The document under itsunified format is called an “information element”. One of the goals of aunified format is to provide an easy and constant manner of presentingvarious documents or data, using the same pattern. An informationelement can also be done by direct writing by the user inside the SMLOIusing any mean like a keyboard or a pen-pointing device. An informationelement generally presents an image of the document, the multiplecharacteristics linked to the inserted document, and other informationrelated to document and to the SMLOI. The information element presentseither an image of the document or the real document itself. The usercan access the real document using the application program on thecomputer system directly through its information element.

Each information element is composed by a document and by “areas”. The“areas” are presenting, preferably in a standardized manner, theinformation related to the document in order to give the user aninstantaneous overview of what is related to a given document. The areasare distinct for every information element and are generally superposedon the related document while letting the underneath document imageappear in order to allow the user to see the document. The areas arealso utilized to manipulate the SMLOI functionality and are consideredas a specific interface for each information element in the SMLOI. TheSMLOI then provides a global interface and multiple specific interfaces.

FIG. 12 shows a complete information element 150 unified representation.The document image 154 is completed by an information area 156, ananterior assemblies area 158, an intra-document multi-page area 160 andan ulterior assemblies information area 162. Alternatively, the anteriorand ulterior assemblies information areas can be located at theinformation element bottom 163.

The information area 156 is itself divided between a date of entrysub-area 165, an event-task-action sub-area 166, a information elementcharacterization attributes sub-area 167, a hyperlink sub-area 168 andan entry sequence number sub-area 169. The information area 156 aspresented by FIG. 12 is partially surimposed on the document so it iseasy to see which area is related to a specific document.

The date of entry sub-area 165 indicates the moment when the informationelement was inserted in the SMLOI. Generally the user keeps the entrydate generated automatically by the SMLOI but it is possible for theuser to voluntarily modify the date of entry. The date of entry can bemodified if the user wants the information element to appear in theSMLOI at a different sequential order. If the date of entry is modified,the original date of entry can be kept by the SMLOI. The informationelement that has multiple dates of entry can be seen at multiple placesin the sequential order of the SMLOI.

FIG. 12 shows the event-task-action sub-area 166. This sub-area has thespecific role to provide all kind of time-related information to theSMLOI user. Time-related information includes meetings, tasks, alarms,status, reminders, or the like. Icons and text are mixed to give avisual effect in addition to sound that attract the user's attention.The background color of the event-task-action sub-area can change togive the user further visual indications. For instance, green could meanthat everything related to that information element is completed, whileyellow could mean that something is currently ongoing and red thatsomething is late or past-due. Flashing background color may also have aspecific meaning. Selection of this sub-area 166 or selection of thetext/icon using the pointing device acts on specific functions as thecreation or the modification of a task, an event, or an alarm. Theinformation contained in this sub-area may also generate a to-do list orbe fully integrated with the agenda.

The characterization attributes sub-area 167 as shown in FIG. 12presents intrinsic and extrinsic characteristics that provide themeaning of the information element according to the SMLOI user. Thecharacterization attributes can be categories, information elementtypes, status, specific sequences according to time or statisticresults; it is in fact any mean that gives order or meaning to theinformation elements. The user can have its own characterizationattributes and can have characterization attributes that are shared by agroup of SMLOI users. Each characterization attribute selected by theuser to be linked with the information element will be presented in thissub-area 167. The visual presentation of each characterization attributewill preferably be in the form of a button or an icon so the SMLOI usercan easily select anyone of them individually or in group with thepointing device. The latter action will allow the user to generaterelative vectors that will be further explained in this description. Thevisual aspect of the selected characterization attributes will change sothe user will easily know which characterization attribute has beenselected. The background color of the sub-area 167 can change to givethe user further visual indications. The order in which thecharacterization attributes are presented in the sub-area is setaccording to the user's preferences.

The hyperlink sub-area 168 as shown in FIG. 12 contains externalhyperlinks and internal hyperlinks. External hyperlinks are generally oftwo types, internet related hyperlinks and other users' SMLOI directaccess. Internal hyperlinks are generally direct links to otherinformation elements in the SMLOI of the same user. This has the purposeto give direct access to the information element references so the usercan have a quick overview of the links to the information element he orshe is visualizing.

The entry sequence number sub-area 169 as shown in FIG. 12 presents asequential number that indicates the sequence in which the informationelements are entered in the SMLOI. The entry sequence number helps theuser to have an intuitive way of classifying each information element.The entry sequence number are hyperlinks in the SMLOI so it is possiblefor the user to use them to draw quick access path between differentinformation elements in the SMLOI. The entry sequence number can be usedas hyperlinks between multiple distinct SMLOI thereby giving directaccess to other users information elements using the same intuitivemethod; although, when a user has another user entry sequence number inits SMLOI this entry sequence number will be preceded by the other SMLOIuser number.

FIG. 12 also shows the anterior assemblies area 158. This area gives theuser a direct view of the anterior assemblies, versions, or annotationsof the visualized information element according to the time vector 32.The user can directly access another information element assembly byselecting the desired assembly in the anterior assemblies area 158.

FIG. 12 shows the ulterior assemblies area 162. This area gives the usera direct view of the ulterior assemblies, versions, or annotations ofthe visualized information element according to the time vector 32. Theuser can directly access another information element assembly byselecting the desired assembly in the ulterior assemblies area 162.

FIG. 12 also presents an alternate way for presenting the anterior andulterior assemblies. The alternate anterior and ulterior assembly area163 presents various assemblies, versions, or annotations, according tothe time vector 32. The current information element 150, in FIG. 12, isalso presented in the anterior and ulterior assembly area 163 as theassembly at location 170. Variation in the size of the presentedassembly helps the user to perceive the closest assembly from thecurrently visualized information element 150, 170.

The multi-pages document area 160 as shown by FIG. 12 presents to theuser a few other pages from the information element 150 if theinformation element 150 includes more than one page. If the informationelement 150 includes for instance 5 pages, the multi-pages document area160 will present the four that are not shown in the document image 154.The user can select them if he or she wants to have a bigger picture ofthe desired page. If the number of pages is larger than the spaceavailable arrows 171, 172 will indicate that there is more pages to seeso the user can scroll up or down to visualize them.

FIG. 13 a presents an information element 150 with its information area156. The date of entry area 165 generated by the SMLOI is applied to theinformation element in FIG. 13 b. The date the information element isentered in the SMLOI can be seen in its date of entry area 165. Thebackground color of the date of entry area can change to give the userfurther visual indications. Selection of this sub-area using thepointing device acts on specific functions.

When the user inserts a document in the SMLOI he or she can select theappropriate characterization attributes. FIG. 14 presents a means toselect the appropriate characterization attributes for an informationelement 150. Entry window 174 is used for the display of the intrinsicand extrinsic characterization attributes. FIG. 14 also presents, forinstance, only extrinsic characterization attributes. When the userclicks on the characterization attribute sub-area 167, the informationelement characterization entry window 174 opens, allowing the user toadd, modify, or delete information element characterization attributeswhile getting access to his/her list of “favorites” characterizationattributes. The user can either type in a new 176 characterizationattribute or click on the proposed characterization attribute or clickon the arrow to have the characterization attribute list appear on aspecific topic. Picking one with a pointing device from the list willmake it appear with a button in the characterization attribute sub-area.To increase the first-glance impact, symbols and colors are added to thecharacterization attribute sub-area 167 as well.

In the event of a subsequent alteration of these characterizationattributes, a trace can be kept of both the change details and theoriginal information. Not all extrinsic characteristic attributes needto be typed in each time. That is, user should be able to build his/herlist of favorites, and to select from it. The most frequentlycharacterization attribute can be displayed automatically at the top ofthe list by the SMLOI. The user is also able to link an informationelement to a task he or she has to perform or to an event, such as ameeting minutes being linked to the agenda. These are statutorycharacterization attributes.

The SMLOI provides a unified format for audio and video documents. FIG.15 shows an information element 150 that is an unified formatrepresentation of an audio document with its title 180, duration 181,and audio symbol 182.

FIG. 16 shows a dynamic layer over the unified format representation ofan audio document. The title 180 and symbol 182 are part of the basicaudio information element 150. Dialog box 185 is part of the layer andallows the commentaries to be displayed/sounded as the basic audioinformation element is displayed. The display bar 187 gives an idea tothe SMLOI user on the position of the audio listening. The positionindicator 189 moves from left to right as the video document is playedin typical media player fashion; using the pointing device, the user candrag this position indicator 189 to the left or the right, and resumelistening to the document at another point. The musical symbol 190 inFIG. 16 is the indicator of additional audio comments added to a layerover the audio information element 150. The triangular symbol 192 is(for instance) an indicator of a written comment added to a layer overthe audio document and shown at a specific time. The camera symbol 195is an indicator of a video comment added to a layer over the audiodocument. A duration indicator shows up when the user points thepointing device to one of the comment indicators and displays in thewindow 185 the time at which the comment has been inserted over thetotal duration of the original information element.

In FIG. 16 are buttons 194 typical of media player, pause, stop, play,fast reverse, and fast forward, respectively, and, in addition, commandsfor displaying/activating comments. Comment window 185 shows the writtenand visual, graphical and video related comments/documents as theirinsertion point is reached while the document is played or as the userclicks on the related indicator 192, 195, 190. If so desired by theuser, the document can be automatically stopped from playing momentarilyas comments 192, 195 and 190 are “reached”.

FIG. 17 shows an information element 150 that is a unified formatrepresentation of a video document with its title 180, duration 181,video symbol 196 and projection window 198 that is used for displayingthe video information element 150 of FIG. 17. FIG. 18 shows an assemblybuilt from the addition of a dynamic layer over the unified formatrepresentation of a video document. The title 180 and symbol 196 arepart of the basic information element and are visible through the clearsubstrate of the layer. The functions are generally the same as the onespresented previously for an audio document in FIG. 16

FIG. 19 a shows an information element where the image 200 is the actualpicture of a web page as an information element in the SMLOI. The usermay either copy information as presented by FIG. 19 a into the SMLOI orjust write an hyperlink to reach the information as in FIG. 19 b. FIG.19 b shows an alternative representation of the same element with onlythe symbol 198 on the center of the page and the web address (URL) 199.

Numerous software applications are available to help users keep track oftheir schedules and of the tasks they need to accomplish. The tasks ofthe user can be displayed as information elements in the SMLOI, and begraphically recognizable within the SMLOI. Tasks as information elementscan be associated with related sub-space (item 166 in FIG. 12) andlinked to appropriate characterization attributes. Color and other typesof coding are part of the unified format representation of such aninformation element to graphically inform the user of the status of agiven task as previously described. The appropriate sub-area willdisplay codes related to the task as well as the due datecharacterization attribute. Events from the agenda (such as meeting) ornot (such as voice messages or conversations) can be displayed asinformation elements, and be graphically recognized as such within theSMLOI. Details of the event such as date, time or location areaccessible directly form the information element. The user cangraphically visualize linked tasks (such as preparation for meeting oran action resulting from a voice mail) as well as linked informationelement (such as a list of documents he or she may need to recover to goto a given meeting). The user is able to visualize linked tasksgraphically, as well as linked elements of information (such as a listof document he or she may need to recover as part of the task). The usercan create work lists, prioritized or not, from the tasks inserted inthe SMLOI.

Information elements can be linked to individuals (such as a list ofparticipants present at a meeting where a given report has beendistributed). Such a link can be established by 1) entering the event asan information element, with its participants as characterizationattributes as well as indicating another element (the report) as anhyperlink and 2) by asking on that information element or on the areasof the information element to visualize the linked elements, which wouldthen show the event on the relative representation vector.

For an information element of an event entered in the SMLOI, thestatutory sub-area would become the event sub-area by displaying codessuch as “preparatory task to be done”, “past event” or “event to come”,etc. . . . A direct link to another information element can be includedin the characterization attribute sub-area or in the hyperlink sub-area.

The SMLOI can display documents that were meant to be printed on paperformats different than the user-specified default format (“letter” papersize for instance). FIG. 20 shows an example of such an odd-sizeddocument, where the proportions of the image are similar to the ones ofthe real document. Such an approach could, however, prove to be ratherinconvenient if more than one element is to be viewed at the same time.It then may be desirable that all the information elements be displayedwithin a common-size “envelope”. FIG. 21 shows such an arrangement,where 202 is the image of the document and a label 203 indicates thetrue size of the document. The information element “envelope” would thenalways be the same for “letter” paper size proportions.

The user can keep track, via his/her SMLOI, of all of his/herinformation elements, even if they are not under an electronic format. Anumbering system for those external reference materials may be createdand a short comment for each may be written. FIG. 22 shows an unifiedformat representation for an information element linked to an externalreference material where a symbol 205 used to designate such externalreference material. A title 206 given to the document by the user, alabel 207 showing the number of the document as per the user's numberingsystem, and the location 208 where the actual document is physicallykept may also be implemented.

Some information elements collected by a user can be made available forviewing by others as a means to stimulate creativity. For instance,interesting articles could be sent to a “pool” and available forbrowsing by other SMLOI users or be sent one at a time at a specificrate through e-mail to selected SMLOI users. A user may also choose tohave old clippings sent to him/herself after a certain delay to refreshhis/her own memory. Random order element visualization is also anoption. Such elements could be sent through e-mails or be used as the“desktop of the day”, the “screensaver of the day”, or even be displayedin SMLOI as “publicity stripes”.

The SMLOI user can select the “SMLOI web site” attribute. By doing so,the user may build a “SMLOI web site” with the selected informationelement. The user website will present the selected information elementsin a web page for others to visualize the information elements on theInternet using a browser “plug-in”. This way, the SMLOI user can shareto everyone on the internet the selected information element without anycomplicated task. The other SMLOI functions that will be furtherdescribed are also enabled within a browser plug-in.

The SMLOI includes a “collection tool” allowing for easy gathering andorganizing of a series of information elements. Options for display arealso offered to the user such as a formal portfolio, scrap book,logbook, notebook, or slide show. These collections may be sent to otherSMLOI users, not as memory-consuming-bunch of files, but rather as alist of links and punctual access rights.

The SMLOI has an enabled collection process. For instance, five elementsare selected by the SMLOI user who then creates a collection therefrom.The collection then becomes an element which, among its attributes, hasthe intrinsic characterization attribute “collection” and is inserted inthe SMLOI. The user can then use the collection in many ways. Forexample, the user may send access rights to another user or do a full orpartial print of the information elements. The user could also visualizeor print a list of the information elements contained in the collectionor create a slide show of the information elements that could be sent orbecome presentation material.

It may also be desirable for the SMLOI to narrow the gap between theelectronic data management and the more traditional handwritteninformation. This may be accomplished with the SMLOI through theintegration of handwriting recognition, applicable software, andelectronic signature capability. This may also be accomplished byintegrating in the SMLOI the capability of generating encodednote-taking material and properly filing the digitized. Apurpose-printed note paper (or template) may also be generated by theSMLOI and printed. The template is then used as normal paper for takingnotes and is scanned for its insertion in the SMLOI. During the scanningprocess, the SMLOI recognizes identification marks on the template (suchas a printed bar code or a hand filled boxes) and assigns intrinsicattributes accordingly as it creates a new information element in theSMLOI.

The Multi Dimensional Representation

In order for a user to keep track of the sequence in which theinformation elements are related to each other, the SMLOI provides a wayto keep specific sequences between information elements. One means ofestablishing such a sequence is by representing the entry of aninformation element. While this would keep the information elements inthe order that they have been entered, the SMLOI is also providing anentry sequence number. FIG. 23 shows an element 150 that is added to apile of elements 210 where the entry sequential number for the firstelement 212 entered has number one and the last, “n”. The new element214 added then gets the sequential entry number “n+1”.

The invention provides a way to see part of a sequence through precedingand following information elements. For example, FIG. 24 illustratesthat the information elements 150 are placed side by side and in theorder that they had been entered. The last information element added tothe sequence would be the one at the extreme right 216 according to thetime vector 32. FIG. 25 shows another way of viewing the sequence. Theinformation elements 150 are placed side by side and are rolled in thatorder on a roll 218 still according to the time vector 32.

The time vector 32 usually represents the absolute chronological orderthat is applied on information element vectors whether they areincluding all the information elements or only a portion. Absoluteinformation element vectors and relative information element vectors arethen linked to a time vector. The time vector can be replaced by aspecific sequence vector that is not necessarily related to time. Inthat order, only the sequence aspect of the time vector would be keptand applied with some other consideration, like statisticalconsiderations, to a specific sequence. Hence, an information elementvector can be related to the number of times an information element hasbeen selected. That is, the information element vector presents theinformation elements in an incremental order. The information elementvector can also be generated ascendingly or descendingly considering thesize of the information elements. The information element vector mayalso present the information elements considering the number ofcharacterization attributes applied to each information element from theinformation element with the most to the least.

The spreading-the-information-elements exercise, shown on FIG. 24 andFIG. 25, directionally towards the right may also be done in anydirection. The display of the information elements in such a mannercreates an information element vector allowing the user to visualize theinformation elements entered as well as the absolute sequence into whichentry has been done.

The system user can introduce “breaks” and “bookmarks” in theinformation element vectors to have reference points within the sequenceof information element entry. FIG. 26 shows such an implementation ofbookmarks 220, 224 where, in that case, the bookmarks are relative to aperiod of time. For instance, two information elements have been enteredduring the period P 222 which is delineated by bookmarks 220 and 224.The bookmarks may also be specifically placed by the user as periodmarkers as shown in FIG. 26 and/or automatically by the SMLOI at everyperiod of time and/or in any user-defined manner.

FIG. 27 shows a bi-dimensional information element vector dispositionwhere all the information elements 150 from the user's SMLOI arerepresented along an horizontal vector 230, where the most recent isshown on the right side according to the time vector 32. Informationelement vector 230 is the absolute information element vector.

The information element 246 is selected by the SMLOI user and at thesame time the “E” characterization attribute 234 is selected by the userstill acting on information element 246. A second information elementvector 232 is generated by the SMLOI at a different angle (generally ata 90° angle from the absolute vector 230, on a 2D display) than thefirst information element vector 230 using the selected informationelement 246 as the intersection point. On the second information elementvector 232 are shown only the information elements sharing the “E”characterization attribute 234 presented in the characterizationattribute sub-area. The most recent of the elements being shown at theupper end of the vector according to the relative time vector 236. As aresult, the information element vector 232 is a relative informationelement vector. It is important to note that information elements 238and 240 are actually the unified format representation of the samedocument because they appear in the absolute information element vector230 and the relative information element vector 232 screening for the“E” characterization attribute 234. This is also true for elements 242and 244. The generation of the relative information element vector 232can also be created according to the combinative logic equation ofmultiple characterization attributes (for instance: “A” AND (“B” OR“E”)).

The absolute and relative information element vectors 230 and 232 inFIG. 27 create a plane (accordingly, they are co-planar). A volume canbe generated depending on the number of information element vectors whendepth is used a third dimension. This plan, or volume if the depth isused, can be considered as a vectorial space 250.

It is possible that the relative information element vector that carrythe selected attribute appear on every information element on theabsolute vector including the selected attribute. As shown in FIG. 28,two additional vertical vectors 248 and 252, aligned with elements 254and 256, respectively, are provided.

FIG. 29 shows the SMLOI, now “tri-dimensional” with the addition ofassemblies 257, 258 and 259 (or information element versions) related totheir respective information elements 262, 263 and 264. The firstdimension is the absolute information element vector 230 according tothe absolute time vector 32. The second dimension is the relativeinformation element vector 232 containing the attribute “E” 234according to the relative time vector 236 with its intersection centeredon the information element 246 from which the characterization attribute“E” is selected. The third dimension is another relative vector relativeto time vector 265 and shows the assemblies relative to informationelements that possess at least one assembly with the more recent beingshown on top according to the time vector 256.

FIG. 30 shows that the system may have four dimensions. The fourdimensions are presented on the SMLOI where 270 is the first dimension,or absolute information element vector, 271 is the second dimension orrelative information element vector and 272 is the third dimension orrelative information element assemblies vector. Item 273 represents thefourth “circular” characterization attribute selection dimension. Thecharacterization attribute choice, in order to generate the seconddimension 271, is a dimension that can be schematically represented as a“circular vector” that can be visualized as orthogonal to the firstinformation element vector axis.

FIG. 31 shows that since there are at least as many relative informationelement vectors 271, 275, 276 as there are characterization attributes,all the relative sequences can be represented as many rays 278 comingout of a center hub 280 that are the selected information element 246 onthe absolute information element vector 270. The fourth dimension 273 asit appears on FIG. 31 is an array of rays 278 and the selection of one(or composition of many) dictates which relative sequence becomes thesecond dimension displayed as the relative information element vector.The SMLOI user can group the information elements by combination orsegregation of characterization attributes. Using combinative logic,this actually would turn the fourth dimension 273 into an infinitenumber of rays around the center hub 280 of FIG. 31.

When a proper computer system is used, characterization attributeattribution to an information element or selection in order to generatean information element vector can be made automatically by the SMLOI.Algorithms, statistics and other mathematical equations are used tochoose the most applicable characterization attributes for a specifiedinformation elements or group of information elements in order to createa information element vector.

The SMLOI also provides an intuitive and efficient system for managingthe user's elements of information, personal or professional in nature.The user and his or her professional information can be part of a biggerpicture if he or she is an employee of a corporation for example. TheSMLOI user is able to visualize his/her personal andprofessional/corporate SMLOI (distinction coming from one majorattribute) at once or separately, and that that option be carried outthrough a single command.

A corporation is considered a moral user of the work related informationof its employees. A corporation or other multi-user environment can haveall its employees dealing with information elements in a similar mannerfor training purposes, and for the preservation of the “corporateknowledge” (structured and unstructured data), and for prior artrecording purposes. The “corporate knowledge” is considered as a seriesof “parallel SMLOIs” with an SMLOI for each of its employees in asimilar fashion to the previously described parallel paths forindividuals. That way, some members of the corporation are able toaccess the information in the corporation's employees SMLOI.

At least one member of the corporation has the “knowledge administrator”status such an individual has full access to the corporate SMLOIs, canforward corporate messages to employees' SMLOI, and create standardizedcorporate characterization attributes to ensure cohesion in the filing,among other functions and capabilities. Such an administrator may have aformal role in a quality-assured environment, such as one governed bythe ISO 9000 standard or a sophisticated information management analysisin order to provide an information management score that canquantitatively show the user's ability to manage its information.

The corporate administrator can represent the corporation in anintuitive manner, such as the corporation organizational chart 282 aspresented in FIG. 32 and directly link to every corporate SMLOI in thecorporation as shown on FIG. 33. FIG. 33 shows the corporate SMLOI of anemployee that has the position 283 in the organizational chart 282. Theplanar representation on the organizational chart is considered as thefifth dimension of the SMLOI. The organizational chart for that purposecan be replaced by a grid 285 on FIG. 34 and is, to the corporation useror administrator, a graphical representation of the multiple users. Inthis case, a two-vector system, for instance “5x” 287 and “5y” 288 isused to “name” different SMLOI users in the corporation, using an alphanumeric format. Other formats may also be implemented.

FIG. 34 shows the fifth-dimension grid 285 where squares are filledusing different patterns according to possible access. The grid of FIG.34 is seen through the eyes of a user represented by box 294 of FIG. 36.As indicated by square 292 of FIG. 34, total access is given at thatposition of the grid. Hatched squares as in box 296 indicate the SMLOIof fellow employees to which the user 294 has full access(professional/corporate side only). Cross-hatched squares in box 297indicate an SMLOI where punctual or microscopic access has been grantedto user 294 (of box 292) allowing visualization of selected elementsonly. Smaller cross-hatched squares as in box 298 indicate the SMLOI towhich the user of box 292 has absolutely no access to.

FIG. 35 shows the multi-dimensional graphic user interface of anemployee of the corporation SMLOI where dimension one 270, dimension two271, dimension three 272, and dimension four 273, as prescientlydescribed, can be seen. Dimension five 287, 288 may also be added. Thedarkened square contour of the grid 285 at the position “B2” indicatesthat the SMLOI 290 is the SMLOI of the “B2” employee.

An employee may allow access to his or her SMLOI, in part or in whole,to another employee or user. The user has only access to a portion ofits SMLOI (such as the professional part) while maintaining the privacyof the remaining portion (such as the personal part).

FIG. 37 presents the absolute information element vector of the SMLOI ofa user “A” where it is possible to see that information elements 315 and316 have no access restriction. Information elements 309, 310 and 311can be locked so the user can block modification access to them. Theopen padlock icon 313 is representing that access is open although itcan be locked. The lock 314 on information element 312 indicates theaccess is denied (which is a default mode for personal informationelements).

FIG. 38 shows the absolute information element vector of the SMLOI of auser “A”, as seen through the eyes of a user “B”, where “B” has onlyaccess to some information elements. Items that have a dark hatchfilling 300, 301, 302, 303 are information elements for which access hasbeen denied to “B” (because of the professional/personal firewall and/orspecific access restrictions for a given element). Items 304, 305, withno hatch filling, are seen as they would be through the eyes of a user“A”, the SMLOI owner. These information elements can be seen by the user“B”, through his/her SMLOI.

For privacy reasons it is desirable that non-accessible elements, ortheir quantity be non-visible to other users. FIG. 39 shows the sameSMLOI, as seen through the eyes of user “B”, where all non-accessibleelements are hidden, and space between accessible elements is reduced.For similar reasons, some parts of the seeable information elements,such as entry sequence numbers, may be hidden as well. Accessibleinformation elements vector 320 all have their entry number “blackedout” so that neither the number of elements in the SMLOI or theirrelative position in the sequence can be known of user “B”.

FIG. 40 shows information element vectors of the SMLOI of one user “A”where, the user has granted access to information elements 324, 325,326, 327 to user “B” while refusing him/her access to elements 328, 329,330, 331.

FIG. 41 shows a absolute information element vector, from the SMLOI of auser “A”, from which information elements 338 and 339 are locked so theycannot appear in the “B” user's SMLOI. FIG. 42 shows the same SMLOI, asviewed through the “eyes” (and SMLOI) of user “B”. Information elementsare hidden and replaced by one empty space 342 having a size that isirrelevant of the number of hidden information elements.

The Interface

One proposed SMLOI interface using a typical windows-like environmentmain screen is shown in FIG. 43 although, the SMLOI can also be voicecontrolled. Item 450 is the operating system's bar displaying SMLOIdetails such as version 454 and user ID 456 (user name and user number).Item 452 is the menu bar of typical format and usage. Display of thisitem is left to the user's discretion. Item 458 is the window throughwhich the SMLOI relays most of the information to the user. This is thewindow where the SMLOI is displayed, is known as the SMLOI window, andoccupies the better part of the screen. This window completely fills thespace between the menu bar 452 (if displayed) and the status bar 460.

A typical information element 150 is shown in FIG. 43 with its date ofentry sub-area 165, an event-task-action sub-area 166, an informationelement characterization attributes sub-area 167, a hyperlink sub-area168 and an entry sequence number sub-area 169. The anterior and ulteriorassemblies area 170 are also shown as is the multi-pages document area160. Scroll down buttons 462 are presented on some sub-areas. Marginsfrom the original document 464 are also presented in FIG. 43.

The multi-part toolbox 466 is presented and acts on different functionsavailable depending on the actions the SMLOI user is doing. The toolboxincludes buttons identified by icons that allow the SMLOI user to act onselected elements. In some cases the buttons may call menus or dialogboxes.

The navigation box 468 of FIG. 43 includes buttons to navigate in theSMLOI. It contains all the buttons, identified by icons, to allow theuser to surf or navigate in his/her SMLOI. Button 470 allows movementalong the absolute information element vector 230 according to positivetime vector 32. Button 472 allows movement along the absoluteinformation element vector 230 in the time vector 32 opposite direction.Button 474 allows movement along the relative information element vector232 according to positive time vector 236. Button 476 allows movementalong the relative information element vector 232 in the time vector 236opposite direction. Button 478 is for the “zoom window” function, whilebutton 479 is for “zoom-in” and “zoom out” functions. Button 481 is the“back to the last view” function and button 483 is for “forward to thenext visualized view” function. These functions are similar to the“back” and “forward” functions on a web browser. Button 485 allows theSMLOI user to access his/her intra-SMLOI favorites' list while button487 allows access to his/her Internet favorites' list.

Button 489 allows the user to return directly to the last informationelement entered in the SMLOI while button 491 opens a new “blank”information element in the SMLOI. This enables the user to work directlyon the new information element for inserting pictures or for adding texton a particular project. This is one way the SMLOI can act as a logbookor notebook.

The communication box 495 includes a communication information window497 for displaying all the information the SMLOI wants the user to knowwhen he or she is using it. The communication information window 497concentrates all the communications in the same place; as such, it candisplay alarms, chat, enter phone calls, instant messaging, provide animage of another person when video conferencing or video phone calls.E-mail features are also presented in the communication informationwindow 497 and usual functions such as in-box, new messages, attachdocument to message, reply, reply to all, transfer, exchange an element,sending box, sent box and contacts are available. The agenda and itsrelated functions including adding the agenda or linking an informationelement to the agenda are also included. Both the e-mail and agendacapabilities are fully integrated in the SMLOI.

FIG. 43 also shows the absolute relativisation bar 500 and the relativerelativisation bar 502. The purpose of these bars is to provide abroader point of view to the SMLOI user. The user sets limit dates 504and 506 for each bar so that the length of the time frame represented iscustomized to the user's desires. Days 508, weeks 510, months 512 andyears 514 are displayed time marks, as little bars (each with their ownformat), in the relativisation bars. The relative relativisation bar 502is only visible when a relative information element vector (2^(nd)dimension) is displayed. Signs of different shape and colors (forinstance black triangle 516) can be added as bookmarks to keep trace ofimportant information elements. A cursor providing the actual viewingposition of the SMLOI is provided so it is possible to drag it to movequickly in the SMLOI.

The user can use its SMLOI in five distinct modes: consultation,insertion/creation, modification, list and extraction.

The toolbox 466 includes different functions related to those differentSMLOI modes. There is, for instance, different functions related to theinsertion mode: favorites (bookmark, hyperlink, hyperpage), quickinsertion (direct insertion without extrinsic attributes), tasks, notes,events, video sequences, audio sequences, digitalization (paper, other),and project creation (reports, slides presentations, collections).

The toolbox also includes functions related to the manipulation mode.The buttons include square manipulation tool, copy, paste, elementselection, annotation manipulation, hide element (by sequence of entrynumber, by date), and search (by sequence of entry number, bycharacterization attributes, combinative logic, by date, by contact, bykey word, by document type, options).

There are also functions related to the extraction mode with buttons fordeleting, information element collection (add element, remove element,save collection as a new information element, add note in collection,print collection, present collection as slides).

The toolbox 466 also includes a system functions section includingbuttons for setup (personal setup, system setup, general setup,corporate administrator), “favorites” setup, authentication andsignature (document authentication, electronic signature), back-up,help, screen management (screen saver, wallpaper, information elementpresentation sequence) and the like.

Window 458 of the SMLOI includes two buttons 503 and 509. If the userclicks on the appropriate button, only the personal portion of his/herSMLOI can be visualized 503. If he/she clicks on the second button, onlythe professional/corporate portion of his/her SMLOI can then bevisualized 509. Clicking on both buttons 503, 509 (with the use of theCTRL and SHIFT keys) will allow visualization of both portions ofhis/her SMLOI.

FIG. 43 shows a typical information element 150, with an informationelement characterization attributes sub-area 167, into which eachcharacterization attribute is actually a button 527, or selecting means,that can be clicked for picking the information elements to be includedin the information elements of the relative vector. Selecting blankbutton 528 at the bottom pulls out the main attributes' list forselection of the second dimension. Simple addition of characterizationattributes to the selection can also be achieved in a typical fashion byusing the CTRL and SHIFT keys from the keyboard. The user is alsooffered the possibility of including any given attribute in acombinative logic equation for the selection of the second dimension'svector (a pull-down menu can appear for additions and exclusions).

Such combinative logic capability can, for instance, allow the user toset border dates for his/her selection of elements carrying theattribute “x”, allow him/her to set border entry numbers dates forhis/her selection of elements carrying the attribute “y”, allow him/herto look for attributes common to other system (such as events) or evenallow element selection based on common status (such as tasks).

FIG. 44 shows a view of a user's SMLOI where the central informationelement is 520. Elements 522 and 521 are the preceding and followinginformation elements along the absolute information element vector,respectively. Information elements 524 and 523 are the preceding andfollowing information elements along the relative information elementvector, respectively. Window 530 presents a close view of informationelement 520. Window 531 presents a zoom-out view of information element520 and shows, at the same time, the preceding and the followinginformation elements in order to provide a better perspective of thevisualized information element 520. Window 532 is a zoom-in view of apart of information element 520 which provides the possibility for theuser to visualize details of the information element 520.

The SMLOI also has a “radar screen” display format as shown by FIG. 45.The absolute relativisation bar 500 and the relative relativisation bar502 have weekly time marks 510 (for instance, can be by days, months orother specific time length) extended upward and to the rightrespectively to effectively create a time grid.

An absolute information element vector 550 appears on the grid, and,accordingly, each of its information elements appears as a square 541.The color of square 541 information elements and the flashing aspect ofthe information element indicates something specific about the squareinformation element. For instance, it can show search results orinformation elements representing tasks for which the deadline isapproaching. This can be linked to any particular area aspect of aninformation element.

The relative information element vector 551 presents the same fourinformation elements 542, 543, 544, 545 that appear in the absoluteinformation element vector 550 that share the same selection ofcharacterization attributes. A diagonal representation according to thetwo relativisation bars time frame can be utilized as well.

The “radar screen” display format as shown in FIG. 45 allows the user tohave a meaningful overview of what is happening in its SMLOI. Colors andmovements add information to the visual distribution of the schematizedinformation elements. The background information element can be found inthe “radar screen” in selection the box 557.

As an alternate way of navigating in the SMLOI, the user can drag, moveor resize the selection box 557 and the background view will changeaccordingly so that the user can visualize whatever information elementis in the “radar screen” selection box 557. This function acts like amagnifying glass on a map. When the user is switching from thevisualization of an information element to the radar mode, box 557 onthe radar mode will show exactly how the presented information elementwas on the display device. Also, change in the selection box 557 willchange the background view as well.

FIG. 46 shows the SMLOI in an alternate “radar screen” display format,including the “future” area 550 that acts like an agenda. Accordingly,information element 551 is a task to be done according to the time frameof the relativisation bars 500 and 502. Separators 553 and 554 visuallyseparate the past and the future and, in fact, 553 and 554 are the linesof the present and their intersection point is “now”. This is a way forthe user to graphically represent his/her “to do” list. In FIG. 47 isshown the SMLOI using a web browser or a plug-in applied to a standardweb browser. This way, everyone using a web browser (i.e. for exampleNetscape™ Navigator™ or Microsoft™ Internet Explorer™) can add a plug-in(or means to adapt the web browser to use, to visualize or to act on theSMLOI) that allow the multi-dimensional data locating system to run onthe web browser. A user can access data, information elements, documentsor standard web pages using a web browser with the SMLOI. Non-users canvisualize information, adapted web pages or other documents using a webbrowser with a plug-in. Users can allow access to specific informationelement to be viewed by other authorized users and non-authorized userswith an appropriate web browser. Is considered here a web browser anydevice that allows navigation on the Internet. While using a web browserit is understood that the SMLOI can be web based and communication withthe user is made using a network.

FIG. 47 shows the SMLOI using a web browser as a base program. Item 560represents the web browser software window. Item 562 represents the webbrowser classic tools, icons and toolbars. Item 564 represents thewindows-like OS task bar, item 466 represents the multi-dimensional datalocating system SMLOI toolbox, item 568 represents the multi-dimensionaldata locating system navigation toolbox, item 150 represents theinformation element presented in the multi-dimensional data locatingsystem inside the web browser, item 570 represents a selected attributegenerating the second dimension in the multi-dimensional data locatingsystem, item 572 represents the absolute information element vector anditem 574 represents the relative information element vector.

Story, Game and Simulation

In order to add meaning to the information contained inside the SMLOI astory or a “game metaphor” can be applied to the vectorial space. Thiswould help to link information elements between them to improve the userunderstanding. If necessary, when using a “game metaphor”, a score couldbe calculated using multiple parameters. The SMLOI can use a 3D/virtualreality environment and, to some extent, turn the “chore” of SMLOI intosome sort of a game; the system could even keep records and statisticsof a user's performance as an information organizer and user.

Parameters can be as simple as the time to retrieve any informationelement, the number of elements inserted in the SMLOI per period oftime, the number of information elements exchanged per period of time,the average number of characterization attributes applied to theinformation elements inserted in the SMLOI or the number of informationelements visualized in the SMLOI per period of time. Those examples aregiven to explain that certain parameters can be evaluated and that ascore can be attributed according to pre-established standards.Statistic curves can be used to represent what is considered by anindividual or by a company as “information management standards”.

The possibility is given to the user to access his/her SMLOI and someSMLOI functions and tools through other computerized devices, such as agame console or a PDA. In such cases, the program could be “installed”by the insertion of a “game cartridge”, i.e. a self-containedsoftware/memory block package, or by Internet download.

FIG. 48 shows the SMLOI as seen through a game console 582 and computercontrolled display 580 such as a TV screen. The actions are done usingthe game controller 585.

FIG. 49 shows a typical game console controller. Just as with any game,the user/player can attribute specific commands to most buttons andknobs. Normally the game controller includes a left trigger 590, a righttrigger 592, a left thumbstick 594, a left directional pad 596, a whitebutton 598, a black button 599, a “Y” button 600, a “B” button 602, a“X” button 604, a “A” button 606, a right thumbstick 608, a “back”button 610 and a “start” button 612. Multiple extension slots 615 can beused for connecting additional memory or for connecting amicrophone/headset device.

For example, the SMLOI commands could be allocated as follows: the lefttrigger 590 to move between information elements going back in time, theright trigger 592 to move between information elements going forward intime, a left thumbstick 594 to move on the absolute information elementvector 230 and the relative information element vector 232 and to movethe box 557 when in the previously described “radar screen” displayformat. A click on the left thumbstick 594 selects the visualizedinformation element 150, the left directional pad 596 has basically thesame functions as the left thumbstick 594, the white button 598 insertsa new blank information element 150 ready to be written while the blackbutton 599 brings the user directly to the last information elementinserted into the SMLOI. The “Y” button 600 accesses the “radar screen”display format, the “B” button 602 accesses sequentially the differentmodes in the SMLOI when an information element is selected, the “X”button 604 selects the communication box 495 and the “A” button 606selects the toolbox 466. The right thumbstick 608 is used to move a“pan” view if no information element is selected and moves into thedifferent areas/sub-areas if an information element is selected; a clickon the right thumbstick 608 would select the pointed area part, the“back” button 610 would be utilized just as the back button on a classicweb browser and the “start” button 612 would keep the same role as on agame console.

Multiple command interactions can also be described. For instance, aclick and hold on the left thumbstick in addition to the right/lefttrigger would provide a zoom-in/zoom-out effect. Also, the white button598 or the black button 599 could be used in conjunction with the rightor left triggers 590, 592 to provide other specific commands; this couldbe fully customizable by the user.

One of the goals of adding a “game metaphor” is to improve the userexperience and to bring him/her to a point where managing information isnot a burden anymore but a funny intuitive interesting task. One othergoal is to have a score that quantify the efficiency of the userinformation management.

The description and the drawings that are presented above are meant tobe illustrative of the present invention. They are not meant to belimiting of the scope of the present invention. Modifications to theembodiments described may be made without departing from the presentinvention, the scope of which is defined by the following claims:

What is claimed is:
 1. A non-transitory computer-readable medium thatincludes computer-readable instructions operable to perform a method ofdisplaying an on-screen graphical user interface, the method comprising:providing a plurality of user-selectable icons, and a plurality ofcontent icons representing respective items of contents; generatingimage data for the on-screen user-interface with a multi-dimensionalarray which includes a first axis comprising the plurality ofuser-selectable icons adapted to be arranged in a specific direction andwhich is also adapted to include a second axis comprising the pluralityof content icons in a direction intersecting, or abutting, the firstaxis; and outputting the image data for the on-screen user interfacerelated to displaying the contents to a display, wherein the generatingdisplays the second axis to intersect, or abut, the first axis.
 2. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to perform a method of displaying an on-screenuser interface of claim 1, wherein the second axis intersects the firstaxis at a position of one of the user-selectable icons.
 3. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to perform a method of displaying an on-screenuser interface of claim 1, wherein the second axis comprising theplurality of content icons is generated on a basis of a selection of oneof the user-selectable icons.
 4. A non-transitory computer-readablemedium that includes computer-readable instructions operable to performa method of displaying an on-screen user interface of claim 1, whereinthe second axis comprising the plurality of content icons is generatedon a basis of a selection of an attribute associated with at least oneof the user-selectable icons.
 5. A non-transitory computer-readablemedium that includes computer-readable instructions operable to performa method of displaying an on-screen user interface of claim 1, whereinat least one user selectable icon from the first axis of user-selectableicons is adapted to have an image attribute associated therewith, thepicture attribute being automatically selected when the at least oneuser-selectable icon is selected.
 6. A non-transitory computer-readablemedium that includes computer-readable instructions operable to performa method of displaying an on-screen user interface of claim 1, whereinat least one user selectable icon from the first array ofuser-selectable icons is adapted to have a music attribute associatedtherewith, the music attribute being automatically selected when the atleast one user-selectable icon is selected.
 7. A non-transitorycomputer-readable medium that includes computer-readable instructionsoperable to perform a method of displaying an on-screen user interfaceof claim 1, wherein at least one of the user-selectable icons is athumbnail of an image file.
 8. A non-transitory computer-readable mediumthat includes computer-readable instructions operable to perform amethod of displaying an on-screen user interface of claim 1, wherein atleast some of the user-selectable icons are associated with documents.9. A non-transitory computer-readable medium that includescomputer-readable instructions operable to perform a method ofdisplaying an on-screen user interface of claim 1, wherein at least oneof the axes is adapted to move longitudinally on the display.
 10. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to perform a method of displaying an on-screenuser interface of claim 1, wherein a selection of a user-selectable iconfrom the axis of user-selectable icons is adapted to be made with a gamecontroller.
 11. A non-transitory computer-readable medium that includescomputer-readable instructions operable to provide a user interfacecomprising a first axis of user-selectable icons, at least some of theuser-selectable icons being adapted to display a second axis ofuser-selectable icons thereof, the second axis of user-selectable iconsbeing substantially orthogonally displayable about the first axis ofuser-selectable icons.
 12. A non-transitory computer-readable mediumthat includes computer-readable instructions operable to provide a userinterface of claim 11, wherein the second axis of user-selectableelements is adapted to be displayed on a basis of a selection of oneuser-selectable element from the axis of user-selectable elements.
 13. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to provide a user interface of claim 11, whereinat least some of the user-selectable elements are menu items.
 14. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to provide a user interface of claim 11, whereinthe second axis is sequentially displayed after the first axis has beendisplayed.
 15. A non-transitory computer-readable medium that includescomputer-readable instructions operable to provide a user interface ofclaim 11, wherein at least one user-selectable element from the firstarray of user-selectable elements has an attribute associated therewith,the attribute being automatically selected when the one user-selectableelements is selected.
 16. A non-transitory computer-readable medium thatincludes computer-readable instructions operable to provide a userinterface of claim 11, wherein the second axis is adapted to intersectand scroll through the first axis.
 17. A non-transitorycomputer-readable medium that includes computer-readable instructionsoperable to provide a user interface of claim 11, wherein the secondaxis of user-selectable elements is adapted to move longitudinally onthe display, the movement of the second axis of user-selectable elementsbeing made upon an instruction provided by a user-actuatable controller.18. A non-transitory computer-readable medium that includescomputer-readable instructions operable to provide a user interface ofclaim 11, wherein a selection of a user-selectable element from thefirst axis of user-selectable elements is adapted to be made on a basisof an action performed on a user-actuatable controller.
 19. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to provide a user interface of claim 11, wherein aselection of a user-selectable icon among the first axis of userselectable icons is adapted to cause a second axis of content icons tobe displayed, the user selectable icons from the second axis of userselectable elements having a common attribute.
 20. A system capable ofdisplaying contents, comprising: a control which acquires an instructionfor displaying of contents via a user manipulation; a non-transitorystorage device which stores data for a plurality of attribute iconsassociated with respective types of content, and data for a plurality ofcontent icons representing respective items of contents; a displayoutput module which outputs image data for an on-screen menu related todisplaying of the contents to a display and which displays the contentsacquired from the storage in response to the instruction acquired by thecontrol; a display controller which generates the image data for theon-screen menu with a multi-dimensional array which includes a firstaxis comprising the plurality of attribute icons arranged in a specificdirection on a screen and which also includes a second axis comprisingthe plurality of content icons in a direction intersecting, or abutting,the first axis on the screen, wherein the display controller displaysthe second axis to intersect, or abut, the first axis at a position ofone of the attribute icons selected by the user, and if the contents areadapted to be chronologically ordered, represents the chronology bydisplaying the content icons in chronological order in the second axis.21. The system capable of displaying contents of claim 20, wherein theinstruction includes a selection of a one of the plurality of attributeicons along the first axis causes the second axis of content icons to bedisplayed, the plurality of content icons in the second axis having acommon attribute.
 22. A non-transitory computer-readable medium thatincludes computer-readable instructions operable to perform a method ofdisplaying an on-screen user interface of claim 1, wherein at least oneof the content icons is a thumbnail of an image file.
 23. Anon-transitory computer-readable medium that includes computer-readableinstructions operable to perform a method of displaying an on-screenuser interface of claim 1, wherein the plurality of user-selectableicons visually present a characterization attribute of the respectiveitems of contents.
 24. A non-transitory computer-readable medium thatincludes computer-readable instructions operable to provide a userinterface of claim 11, wherein a selection of a user-selectable iconamong the first axis of user selectable icons is adapted to cause asecond axis of content icons to be displayed, the content icons in thesecond axis having a common attribute.
 25. A non-transitorycomputer-readable medium that includes computer-readable instructionsoperable to perform a method of displaying an on-screen user interfaceof claim 1, wherein the plurality of user-selectable icons aresuperimposed on the plurality of content icons.
 26. A non-transitorycomputer-readable medium that includes computer-readable instructionsoperable to provide a user interface of claim 1, wherein a selection ofa user-selectable icon among the first axis of user selectable icons isadapted to cause a second axis of content icons to be displayed, thecontent icons in the second axis having a common attribute.